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ABSTB&-T 

Becursive  image  segmentation  with  hierarchical  scope 
views  is  a  new  technigue  in  image  processing  which  systemat- 
ically divides  an  image  into  smaller  and  smaller  quadrants 
with  each  region  within  the  quadrants  having  a  structured 
descriptor.  The  regions  are  then  processed  to  remove  noise 
and  to  check  for  connected  regions  across  the  guadrant 
boundaries.  The  quadrants  are  then  brought  back  together 
with  the  obscured  target  enhanced  and  distinguishable  from 
the  background.  Infared  image  data  of  five  different  ship 
targets  with  the  associated  noise  and  inteference  was 
processed  by  this  technique  with  the  target  information 
being  greatly  enhanced.  The  procedures  developed  to  eval- 
uate the  data  were  found  to  be  inadequate  for  the  task, 
neccessitating  hand  evaluation  to  extract  the  target.  Ihe 
technique  was  proven  to  be  a  viable  solution  for  extracting 
target  information  from  infared  data,  but  very  slow 
processing  times  and  inadequate  evaluation  procedures  limit 
the  usefulness  of  the  program  in  its  present  form. 
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I-  INTRODUCTION 

Many  different  approaches  exist  in  the  field  of  image 
processing  to  extract  meaningful  information  from  such 
sources  as  aerial  photographs,  infared  images,  or  TV  camera 
images.  The  major  procedures  of  a  typical  image  processing 
system  are  digitization,  preprocessing,  segmentation, 
feature  extraction,  and  understanding.  As  presented  in 
[Bef.  1],  the  purpose  of  segmentation  is  to  partition  the 
image  into  meaningful  regions  which  depend  on  the  problem 
being  considered.  In  aerial  reconnaissance,  for  example,  a 
practical  application  of  image  segmentation  may  be  to 
extract  regions  corresponding  to  terrain,  industrial  sites, 
or  ships  of  interest. 

There  are  two  catagories  of  approaches  for  the  segmenta- 
tion process.  The  first  category  deals  with  methods  which 
are  based  on  examinirg  an  image  on  a  point-by- point  basis, 
called  a  point  dependent  process.  An  example  of  a  point 
dependent  process  would  be  gray  scale  thresholding.  The 
second  category,  referred  to  as  a  region  dependent  process, 
deals  with  techniques  which  utilize  the  image  formation  in  a 
prescribed  neighborhood.  Examples  of  this  category  of 
approach  are  based  on  edge  detection,  boundary  finding,  or 
region  growing  which  attempt  to  group  points  with  similar 
characteristics  into  regions. 

A  new  method  of  segmentation  utilizing  methods  of  both 
catagories  is  by  gray  scale  thresholding  at  hierarchical 
scope  views  [Bef.  2],  which  breaks  an  image  into  small  quad- 
rants with  the  regions  within  the  quadrants  having  a  struc- 
tured descriptor  and  region  number.  This  method  uses  many 
of  the  techniques  first  proposed  by  Ohlander  (see  [Bef.  3]  ) 
and  then  formulated  into  the  MOOSE  program  ty  Shafer 
[Ref.  3]. 


Additional  segmentation  procedures  are  then  applied  to 
these  small  regions  to  pull  out  details  and  associate 
regions  en  oppsite  sides  of  the  boundaries.  The  segmented 
pieces  are  then  processed  to  ascertain  whether  the  region  is 
valid  or  noise.  All  the  pieces  are  then  brought  back 
together  with  the  meaningful  objects  more  prominently 
displaced. 

Previous  segmentation  processes  have  not  provided  good 
results  when  using  infared  data  as  the  input.  Interference 
caused  by  such  variables  as  temperature  differences,  clouds, 
and  target  variations  have  caused  the  segmentation  processes 
to  fail  in  one  way  or  another-  A  new  program,  called  QUAD 
SPLIT,  will  be  tested  with  infared  data  input  of  ships  in  an 
attempt  to  produce  meaningful  and  useful  information.  To 
extract  the  information,  new  procedures  will  be  required  to 
take  the  output  from  the  QUAD  SPLIT  program  and  process  it 
into  a  form  that  can  te  readily  understood.  The  formulation 
and  testing  of  these  new  procedures,  and  the  testing  of  the 
QUAD  SPLIT  program  utilizing  infared  data  of  ships  as  the 
input  is  the  basis  for  this  research  work. 

An  overview  of  the  recursive  image  segmentation  methods 
utilized  and  their  limitations  are  given  in  Chapter  II, 
while  a  more  detailed  treatment  of  recursive  image  segmenta- 
tion at  hierarchical  scope  views  is  presented  in  Chapter 
III.  The  problems  associated  with  the  program  QUAD  SPLIT 
and  the  development  cf  new  procedures  to  remedy  these  prob- 
lems are  the  subjects  of  Chapter  IV.  The  testing  of  the 
revised  program  with  infared  image  data  and  the  evaluation 
of  the  processed  data  is  covered  in  the  final  chapter. 

The  evaluation  cf  the  processed  infared  data  confirmed 
that  recursive  imace  segmentation  at  hierarchical  scope 
views  is  a  viable  technique  for  extracting  target  informa- 
tion from  noisy  infared  images.  The  procedures  developed 
for  the   evaluation  proved  to   be  inadequate   which  required 
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that  visual  and  hand  calculations  be  conducted  to  effec- 
tively extract  the  target.  These  inadequacies  could  be 
easily  remedied  since  the  reguired  information  is  present  in 
raw  form  and  only  requires  proper  processing.  A  major 
concern  noted  during  testing  is  the  processing  time  required 
for  each  image.  For  complicated  images  with  numerous  quad- 
rant segmentations  and  boundary  checks,  processing  tine  can 
be  in  excess  of  twenty  minutes. 
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II.  EICORSIVE  IMAGE  SEGMENTATION  METHODS 

This  chapter  is  provided  to  give  a  brief  overview  cf  two 
of  the  nethods  used  in  this  work  for  the  segmentation  cf 
image  data.  The  first  section  is  an  introduction  to  the 
MOOSE  program  and  seme  of  its  limitations.  The  second 
section  then  discusses  a  method  by  which  two  of  the  MOOSE 
limitations  can  be  remedied. 

A.   BZCDESIVE  SPLITTIBG 

1 .  Assumptions 

MOOSE  is  a  program  which  implements  a  segmentation 
procedure  using  the  assumptions  proposed  by  Ohlander.  The 
primary  assumption  for  this  technique  is  that  the  surfaces 
in  the  iiage  will  be  represented  by  connected  sets  of  pixels 
with  a  very  close  gray  scale  measure.  The  data  used 
throughout  this  work  are  infared  images  represented  as  a  0 
to  256  gray  scale  over  a  plane.  The  following  additional 
assumptions  are  related  to  overcoming  some  of  the  flaws  in 
the  primary  assumption;  (1)  Each  of  the  connected  sets  of 
pixels,  forming  a  patch,  is  assumed  to  produce  a  gaussian 
peak  when  histogrammed  over  the  gray  scale;  (2)  The  histo- 
gram of  a  collection  of  these  patches  is  assumed  to  clearly 
indicate  a  separation  between  peaks,  with  the  relative 
minima  of  the  histogram  lying  between  these  peaks  rather 
than  cutting  peaks  in  the  middle. 

2 .  Algorithm 

The  basic  idea  of  the  algorithm  is  to  split  the 
image  into  regions,  then  split  these  regions  into  smaller 
regions,  and  so  on,  until  only  very  small  regions  remain. 
The  structure  is  thus  recursive. 
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An  image  is  considered  as  consisting  of  only  one 
region  at  the  beginning.  If  the  region  area  is  larger  than 
a  constant  minimum  size  criterion,  it  will  be  segmented 
further-  A  histogram  of  the  region  is  then  calculated  and 
the  shape  of  the  histogram  is  analyzed  to  yield  a  set  of 
peak  intervals.  The  relative  minima  between  the  peaks  is 
then  used  to  produce  good  thresholds  levels-  The  region  is 
then  divided  by  these  threshold  levels  into  candidate 
patches  that  are  each  assigned  a  distinct  numeric  score. 
The  patches  are  then  collected  by  a  connecting  region  proce- 
dure to  reveal  their  geometric  relationship.  A  patch  must 
have  an  area  greater  than  some  constant  minimum  noise  area, 
otherwise  it  is  considered  to  be  noise  and  merged  with  the 
surrounding  region.  Ihe  patches  are  then  stored  in  a  region 
record.  This  is  then  repeated  for  other  regions  until  no 
further  regions  require  splitting.  the  procedure  and  asso- 
ciated criteria  are  listed  as  follows: 

Procedure  Criteria 


Fetch  a  region  Minimum  area 

Histogramming 
Peak  selection 
Thresholding 
Connected  patch  finding 

Noise  elimination  Minimum  area 

Region  collection 
Repeat  until  region  can  not 
be  split  further. 

3 .   limitations 

This  recursive  method  has  been  applied  yielding 
better  results  than  the  simple  thresholding  of  gray  scale 
approach.   But  there  remain  four  main  limitations: 
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a.   Majority  Bule  Problem 

The  majority  rule  problem  occurs  when  large  and 
small  objects  (or  areas)  occur  in  the  same  region.  large 
objects  will  show  up  strongly  in  the  histogram  and  will 
dominate.  The  smaller  objects  may  not  cause  strong  peaks  in 
the  histogram  and  thus  may  be  covered  by  the  large  distribu- 
tional spread  of  tfce  larger  objects.  Therefore,  these 
smaller  objects  will  rot  appear  in  the  segmented  output. 

t.   No  Well  Eefined  Peaks 

If  there  are  no  well  defined  peaks  in  the  histo- 
gram then  this  procedure  is.  ineffective.  An  image  full  of 
many  small  objects  (i.e.,  cars  in  a  parking  lot)  has  a 
histogram  which  tends  to  have  a  relatively  broad  and  flat 
distribution  with  no  dominate  peaks  or  valleys.  Therefore 
these  objects  will  be  lost  in  the  output. 

c.  Region  Ccnbination 

Regions  selected  in  early  stages  cannot  be 
combined  in  later  stages.  The  region  boundary  formed  in  the 
early  stages  will  never  change  later  on.  Only  more  new 
boundaries   will   show    up  inside   the  old  boundary. 

d.  Constant  Gradient 

Regions  with  constant   intensity  gradient  cannot 

be  detected.    This  can  result  in  the  splitting  of  an  object 

that  has   a  constant  gray   scale  gradient  instead   of  recog- 
nizing it  as  one  object. 
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B.   BECUHSIVE  SPLITTIBG  AT  HIEBABCHICAL  SCOPE  VIEWS 
1 .   Generalities 

This  approach  was  developed  and  implemented  to  avoid 
the  first  two  disadvantages  of  MOOSE.  The  MOOSE  algorithm 
is  incorporated  into  the  program  with  additional  tests  and 
procedures  added.  It  uses  a  hierarchy  of  scope  views  with  a 
large  scope  view  (large  area)  at  high  levels  and  small  scope 
views  (small  areas)  at  lower  levels.  A  quad  tree  (4  branch) 
development  is  used  for  splitting.  Starting  with  a  256  X 
256  pixel  representation,  the  image  is  divided  into  4  quad- 
rant scope  views  by  recursive  image  splitting.  A  test  is 
then  performed  on  the  guadrant  scope  view  to  determine  if 
further  splitting  is  required.  If  the  test  results  are 
acceptable,  the  quad  tree  development  for  this  quadrant 
scope  view  stops  at  this  point  and  is  called  a  terminating 
node.  If  the  test  is  not  satisfactory  for  the. scope  view, 
then  it  is  further  divided  into  four  more  quadrant  scope 
views.  Each  of  these  is  tested  in  turn  which  will  either 
terminate  or  again  te  split  into  four  quadrant  scope  views 
dependirg  on  the  test  result.  This  continues  until  a 
minimum  area  criteria  is  violated  for  splitting  or  all  scope 
views  test  satisfactorily  and  terminate. 

The  test  used  to  check  for  acceptable  results  is 
based  on  the  spread  width  of  the  histogram  generated  for  the 
scope  view.  An  object  containing  a  large  number  of  objects 
and  a  wide  variation  of  gray  scale  levels  would  tend  to  give 
a  broad  distribution  histogram  with  no  well  defined  peaks. 
If  the  spread  width  exceeds  a  maximum  value  set  up  by  the 
test,  then  the  test  is  considered  not  satisfactory  and  the 
scope  view  will  be  split  into  quadrant  scope  views.  The 
test  is  then  performed  on  these  smaller  scope  views.  Thus 
because  the  larger  quadrants  are  broken  up  into  smaller 
guadrants  with  a  better  possibility   of  finding  well  defined 
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histogram  peaks,  the  majority  rule  and  no  well  defined  peaks 
problems  associated  with  MOOSE  are  related. 

2.   Boundary  Problems 

Cne  of  the  major  problems  of  quad  tree  generation  is 
that  discontinuous  boundaries  may  exist  from  one  scope  view 
to  another.  Two  neighboring  scope  views  with  adjacent 
borders  sometimes  have  different  peak  interval  values  which 
may  lead  to  a  non-clcsed  region  boundary  in  one  scope  view 
being  discontinuous  across  the  border.  A  boundary  checking 
procedure  was  developed  to  alleviate  this  protlem  and  is 
discussed  in  greater  detail  in  the  next  chapter. 

C.   CCHC10DIHG  BEHAfiKS 

Two  very  related  methods  have  now  been  introduced  for 
the  segmentation  of  images.  It  can  be  seen  tha  the  recur- 
sive splitting  at  hierarchical  scope  views  is  just  a  refine- 
ment of  the  basic  MOCSE  program  with  the  program  QUAD  SPLIT 
using  MOCSE  as  its  major  building  block.  A  more  detailed 
discussion  is  provided  in  the  following  chapter. 
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III.  EEC OB SI YE  SPLITTING  WITH  HIEEABCHICAL  VIEWS 

In  order  to  take  infared  data  of  a  ship  and  process  it 
into  a  useful  output  requires  extensive  preparation  and 
knowledge  of  the  system  used.  This  chapter  highlights  the 
different  problems  involved  in  making  these  preparations  and 
a  more  detailed  look  into  the  workings  of  the  major  proce- 
dures of  the  segmentation  program  used  for  this  work. 

A.   GEHFEAL 

The  QUAD  SPLIT  program  is  the  primary  tool  that  was  used 
in  this  research.  The  MOOSE  algorithm  is  the  basis  fcr  the 
QUAD  SPLIT  program.  Therefore  a  thorough  understanding  of 
all  the  procedures  of  both  was  required.  The  version  of  the 
QUAD  SPIIT  utilized  was  written  in  PASCAL  and  contains 
approximately  5000  lines  of  code.  Thus  a  more  than  basic 
knowledge  of  PASCAL  was  also  required  to  ascertain  what  was 
happening  in  each  of  the  many  procedures  and  where  all  the 
information  was  stored  for  future  use.  With  no  prior  knowl- 
edge cf  this  language  before  the  start  of  the  research,  very 
much  valuable  time  was  consumed  in  acquiring  the  needed 
knowledge  as  new  complexities,  structures,  and  formulations 
were  encountered. 

QDAD  SPLIT  is  a  very  complicated  program  which  was 
implemented  without  regard  to  speed  of  execution.  This  made 
the  tracing  through  and  understanding  of  the  inner  workings 
of  the  program  very  difficult  because  many  of  the  procedures 
are  nested  within  other  procedures  which  again  are  nested  in 
still  ether  procedures. 

The  infared  data  available  for  evaluation  and  testing  is 
on  magnetic  tape   in  a  64  X   256  array  of  gray   scale  levels 
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from  0  to  255.  QUAD  SPLIT  requires  an  input  data  file  of  a 
256  X  256  array.  This  data  file  was  generated  by  formu- 
lating a  short  PASCAL  program  to  copy  the  infared  data  in 
the  first  64  lines  cf  the  array  and  putting  the  value  1  in 
the  rest  of  the  array.  With  this  type  of  input  file 
supplied  to  QUAD  SPLI1,  it  required  an  average  of  10  minutes 
for  the  program  to  run  to  completion  and  produce  an  output 
file. 

B.   HAJOE  PROCEDURES 

1«   Hierarchical  Segmentation 

QUAD  SPLIT  takes  the  input  data  and  reads  it  into  a 
global  record  which  is  available  throughout  the  program. 
The  256  X  256  array  is  considered  the  initial  scope  view  and 
is  at  the  highest  level  of  the  hierarchy  at  level  8  (2  **  8 
=  256).  When  a  scope  view  is  divided,  it  drops  one  level 
(i.e.  128  X  128  =>  level  7,  64  X  64  =>  level  6,  etc.).  The 
level  8  image  is  automatically  divided  into  four  quadrant 
scope  views  at  level  7.  The  upper  left-hand  quadrant, 
called  Nw",  scope  view  (from  0,0  to  128,128)  is  tested  first. 
The  histogram  for  this  scope  view  is  calculated  which  is 
then  checked  for  significant  peaks.  The  candidate  peaks  are 
then  tested  for  spread  width  to  determine  if  further  divi- 
sion is  required.  If  so,  the  level  7  scope  view  is  divided 
into  four  level  6  quadrant  scope  views.  The  NW  scope  view 
is  again  checked  first  to  determine  whether  further  division 
is  required.  A  minimum  area  criteria  for  scope  view  area 
precludes  division  below  level  5  (32  X  32) . 

when  a  scope  view  requires  no  further  division,  the 
local  nirima  between  peaks  is  determined  to  set  up  threshold 
levels  for  assigning  unique  region  numbers  to  the  position 
in  the  scope  view  that  fall  within  the  threshold  levels. 
Por  example,  assume  there  are  peaks  in  the  histogram  at  gray 
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scale  levels  100,  175,  and  220vith  local  minimas  at  150  and 
200.  Ihen  for  each  array  position  in  this  scope  view  with  a 
gray  scale  level  below  150r  a  unique  region  number  would  be 
assigned  (i.e.  4),  while  array  positions  for  gray  scale 
levels  between  150  and  200  would  be  assigned  another  unique 
region  number  (i.e.  132),  and  for  array  positions  with  gray 
scale  levels  greater  than  200  would  be  assigned  yet  another 
region  number  (i.e.  777).  Thus,  three  distinct  regions 
within  the  scope  view  have  been  created.  The  scope  view  has 
now  satisfied  its  initial  tests  and  is  considered  terminal. 

The  next  scope  view  to  be  evaluated  is  the  upper 
right-hand,  called  NE,  scope  view  on  the  same  level  as  the 
last  completed  NW  scope  view.  This  continues  on  to  the 
lower  left-hand  (SW)  scope  view  and  finally  the  lower  right- 
hand  (SE)  scope  view.  For  example,  start  at  level  8  which 
automatically  goes  to  level  7.  The  NW  scope  view  of  level  7 
is  checked  first  and  assume  no  further  division  is  reguired. 
The  NE  scope  view  of  level  7  is  then  evluated,  and  assume 
this  requires  divisicn  to  level  6.  Here  the  NW  scope  view 
is  evaluated  first  and  assume  it  is  terminal,  followed  by 
the  NE  scope  view  (also  terminal) ,  followed  by  the  SW  scope 
view  (terminal) ,  and  finally  the  SE  scope  view  which  is 
assumed  to  require  further  division  to  level  5.  Assume  all 
four  scope  views  here  at  level  5  are  terminal,  which  causes 
the  SE  scope  view  at  level  6  to  become  terminal,  which 
completes  the  NE  scope  view  at  level  7  and  causes  it  to  be 
terminal.  This  same  sequence  is  applied  to  the  other  scope 
views  at  level  7  and  at  any  lower  levels  that  may  be 
required  until  all  the  scope  views  at  level  7  are  terminal 
which  in  turn  causes  level  8  to  be  terminal.  This  example 
is  depicted  in  Fig.  3.1. 
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Figure  3.1   Quad  Tree  and  Associated  Scope  View  Developeaent. 
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2-  Noise  Elimination 

The  level  8  array  now  has-  a  version  which  consists 
of  the  different  regicn  numbers.  The  number  of  times  each 
region  number  occurs  in  the  array  gives  the  area  for  that 
specific  region.  This  area  is  then  compared  to  a  constant 
which  represents  the  minimum  area  a  region  must  have  in 
order  not  to  be  considered  noise.  If  the  region  is  less 
than  this  minimum  area  it  is  eliminated  and  is  assigned  the 
region  cumber  that  surrounds  it.  The  area  for  this 
surrounding  region  is  then  updated  and  the  check  continues 
until  all  regions  have  been  checked. 

3-  Eoundary  Checking 

Ihe  array  of  region  numbers  could  now  be  made  avail- 
able in  output  to  give  a  segmented  representation  of  the 
original  infared  data.  Problems  may  occur  at  the  tcundaries 
of  the  different  sccpe  views  because  the  histogram  and 
threshold  levels  used  may  be  different  in  the  adjacent  scope 
views.  Take  for  example  the  simple  situations  presented  in 
Pig.  3.2.  In  scope  view  A,  histograming  and  thresholding 
produce  three  regions  that  end  at  the  boundary.  In  the 
adjacent  scope  view,  scope  view  B,  histogramming  and  thresh- 
olding may  produce  cnly  two  regions  at  the  same  boundary 
which  may  or  may  not  coincide  with  the  regions  of  the  first 
scope  view. 

In  scope  view  D  there  are  two  regions  in  which  cne 
region  is  partially  enclosed  by  the  other  with  an  abrupt 
ending  at  the  scope  view  toundary.  On  the  adjacent 
boundary,  scope  view  C,  there  are  no  breaks  in  the  boundary 
due  to  different  results  for  histogramming  and  threshold 
levels,  even  though  it  appears  that  there  should  te  a 
continuation  of  the  partially  enclosed  region  of  scope  view 
D  across  the  boundary- 
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Scope  View  A 


Scope  View  B 


Scope  View  C 


Scope  View  D 


Figure  3-2   Boundary  Checking  Problems. 

A  procedure  called  SPLIT  CHECK  was  thus  incorporated 
into  QUAE  SPLIT  to  eliminate  some  of  these  potential  prob- 
lems. The  scope  views  into  which  the  image  was  hierarchi- 
cally split  is  recalled.  The  four  quadrant  scope  views  at 
the  lcwer  levels  are  checked  first.   The  rightmost  column  of 
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the  NW  and  SW  scope  views,  called  the  NS  boundary  because  it 
is  vertical  and  runs  from  top  to  bottom  or  north  to  south, 
is  used  to  start  the  check.  Each  position  of  this  cclumn 
has  its  region  number  compared  to  the  region  number  of  the 
position  just  below  it.  If  the  two  values  are  different 
then  the  boundary  between  two  regions  within  the  scope  view 
has  been  detected  and  is  called  a  break.  When  a  break  is 
detected,  the  row  cf  the  position  where  this  occurred  is 
remembered.  The  adjacent  scope  view  boundary  (leftmost 
column  of  the  NE  and  SE  scope  views)  is  then  checked  within 
a  range  cf  +5  to  -5  positions  of  the  row  in  which  the  break 
was  fcund.  The  check  performed  is  the  same  as  detailed 
above  for  finding  a  break.  If  a  break  is  found  within  this 
range,  then  there  is  no  problem  for  the  desired  result  to  be 
realized.  If  no  break  is  found  on  this  adjacent  boundary, 
then  the  adjacent  sccpe  view  is  divided  again,  if  possible, 
with  histogramming,  thresholding,  and  region  number  assign- 
ment again  taking  place.  Boundary  checking  is  then  recom- 
menced with  the  hope  of  now  finding  a  break  in  the 
appropriate  area  on  this  adjacent  boundary. 

If  this  still  fails,  then  the  thresholds  of  the 
original  sccpe  view  regions  for  which  the  break  was  found 
are  recalled  and  averaged.  If  this  new  value  falls  within 
the  peak  interval  for  thresholding  of  the  adjacent  scope 
view  region,  then  it  is  possible  to  dissect  the  peak 
interval  into  two  new  intervals  and  thus  create  two  regions 
and  a  possible  break.  This  is  called  threshold  propagation 
and  is  depicted  in  Eig.  3.3  .  If  this  still  fails  to 
produce  a  break,  then  nothing  more  is  attempted  and  the 
boundary  checking  procedure  continues. 

This  checking  for  a  break  is  done  at  all  positions 
down  the  column  except  at  rows  divisible  by  32  where  scope 
view  boundaries  exist  and  thus  a  break  would  occur.  After 
this  cclumn   is  checked,    its  adjacent   column  is   likewise 
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Figure  3.3   Threshold  Propagation. 
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checked  and  compared  with  the  original  boundary  column  if  a 
break  is  detected.  Next  the  bottom  most  row  of  the  NW  and 
HE  scope  views,  called  the  EW  boundary  is  used  to  check  for 
breaks  in  the  columr  positions.  Any  breaks  found  are 
checked  in  likewise  fashion  across  the  boundary.  This  is 
again  done  for  the  ether  side  of  the  boundary  until  all 
boundary  positions  inside  the  four  scope  views  have  been 
checked.  This  same  procedure  is  repeated  for  all  levels 
until  the  four  scope  views  at  level  7  have  been  finally 
checked,  and  the  procedure  ends. 

**•   Cutput  Generation 

Region  numbers  have  now  been  assigned  to  all  the 
regions  in  the  different  scope  views  and  are  available  in  a 
256  X  256  array.  To  get  a  hard  copy  of  this  region  map  from 
a  printer,  the  region  numbers  must  first  be  converted  to 
single  letters,  numbers,  or  symbols  so  that  each  array  posi- 
tion representing  the  different  regions  can  be  represented 
by  a  single  character.  This  is  accomplished  by  using  55 
different  characters  from  the  keyboard.  The  region  numbers 
are  first  put  through  a  modulo  55  function  and  the  remainder 
is  correlated  to  one  of  the  55  characters.  This  array  of 
characters  is  then  stored  and  is  available  for  output  tc  a 
printer  in  four  128  X  128  pieces. 

By  linking  the  QUAD  SPLIT  program  with  the  PLOT  10 
program  available  on  the  VAX-750,  an  output  depicting  the 
edges  of  all  the  regions  can  be  displayed  on  the  TEXTRCNICS 
console. 
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IV,  IMAGE  BESIBPCTORING 

A.   LIMITATIONS  OF  QDAD  SPLIT 

1  •   Eeqion  Numbering 

As  detailed  in  the  previous  chapter,  each  region  in 
the  scope  view  has  its  own  region  number  which  correlates  to 
its  own  region  character  in  the  hardcopy  output.  At  bound- 
aries there  will  be  different  characters,  even  though  both 
sides  of  the  boundary  may  have  the  same  gray  scale  level  in 
the  original  infared  data.  Therefore  background  features 
such  as  sky,  horizcr,  water,  etc.,  are  broken  up  and 
displayed  by  many  characters  depending  on  how  many  times  the 
image  has  been  split  ever  that  area.  This  problem  is  some- 
what eliminated  by  useing  the  PLOT  10  program  in  some  ether 
form  of  output  because  only  the  edges  are  displayed.  Ihe 
output  must  then  be  visually  interpreted  to  find  the  desired 
features. 

2-   Eeqion  Map,  Output 

Problems  of  duplicate  characters  can  arise  in  the 
output  because  of  using  the  modulo  55  function  to  operate  on 
the  regicn  numbers  when  assigning  characters  to  the  listing 
output.  In  QUAD  SEIIT  the  maximum  number  of  regions  that 
can  he  generated  is  limited  to  64,  while  region  numbers  can 
have  values  from  1  to  4096.  Thus  duplication  of  characters 
is  highly  likely,  but  their  occurence  in  adjacent  regions  or 
across  boundaries  is  rot  often. 

3 .   Background  Features 

The  procedures  and  tests  incorporated  into  QUAD 
SPLIT  for   the  calculation  of  the   area  and  the   centrcid  of 
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each  individual  region,  and  for  making  a  selection  of  good 
features  are  limited  because  of  the  region  propagation 
problem.  Background  features  that  may  occur  in  the  image 
could  have  been  broken  up  at  least  at  scope  view  boundaries. 
Thus,  area  and  centroid  information  become  inaccurate  for 
selection  of  a  target  from  the  background  regions. 
Additional  procedures  for  more  extensive  geometry  comparison 
is  required  to  distinguish  a  target  from  the  rest  of  the 
regions. 

B.   A1GCEITHM  FOSH0LA1ICH 

1 .   Eegion  Number  Propagation 

various  ideas  were  considered  to  accomplish  the 
desiered  region  number  propagation  across  the  boundaries. 
Cne  method  considered  was  to  count  the  number  of  times  a 
region  number  occured  at  a  boundary  and  compare  the  result 
with  a  similar  count  on  the  opposite  side  of  the  boundary. 
Ihe  assignment  of  the  same  region  number  to  those  that 
occured  almost  an  equal  number  of  times  on  both  sides  of  the 
boundary  would  then  take  place.  This  was  quickly  rejected 
because  the  count  on  one  side  of  the  boundary  may  occur  at 
the  top  while  on  the  opposite  side  of  the  boundary  it  could 
occur  at  the  bottom,  and  thus  the  same  region  number  could 
he  assigned  to  completely  unrelated  areas. 

Another  idea'  was  to  count  the  number  of  times  two 
pairs  of  region  numbers  occured  across  a  boundary  and  to 
assign  the  same  region  number  to  the  pairs  that  occured  most 
frequently  or  that  exceeded  a  set  minimum  count.  This  was 
also  rejected  because  one  side  of  a  boundary  may  have  only 
one  or  two  region  numbers  while  the  opposite  side  of  the 
boundary  could  have  numerous  reqion  numbers  and  when  counted 
in  pairs  could  all  realize  the  same  result.  Then  which 
region  numbers  should  propagate  and  which  should  not  would 
have  to  re  decided. 
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Ihe  idea  that  was  finally  selected  as  the  most 
likely  to  produce  the  desired  result  was  to  determine  where 
breaks  were  encountered  on  both  sides  of  the  boundary  and 
then  assign  the  same  region  numbers  to  the  pair  of  regions 
that  cccur  across  the  boundary  on  either  side  of  the  break. 
If  a  break  is  detected  on  one  side  of  the  boundary  hut  with 
no  adjacent  boundary  break  found  within  a  specified  range, 
then  all  regions  would  retain  their  present  region  numters. 
This  is  the  basis  upon  which  the  region  number  propagation 
algorithm  will  be  implemented. 

2.   New  Region  Maj: 

Since  there  are  a  maximum  of  64  regions  available 
from  the  QUAD  SPLIT  program,  this  implies  that  there  are  at 
most  only  64  different  region  numbers  utilized.  Thus,  by 
adding  nine  more  characters  to  the  list  of  55  characters  now 
available,  all  the  6*4  different  regions  could  be  assigned  a 
unique  character  corresponding  to  its  region  number  without 
duplication  being  a  problem. 

3-   feature  Tests 

Easic  FORTRAN  procedures  for  calculating  area, 
perimeter,  center  cf  gravity  (or  centroid) ,  size,  and 
compactness  were  known  to  be  available  on  the  VAX-750  system 
by  using  the  SPIDER  programs  £Ref.  4].  These  procedures 
would  use  the  information  generated  from  the  regior  Dumber 
propagation  procedure  to  produce  their  respective  results 
for  each  region.  The  retrieval  of  the  desired  targets  could 
then  be  rased  on  this  information. 


26 


C.   A1G0BITHM  IHPLEHZ1TATION 

1  -   Background  R e^ion  Check 

The  implementation  of  the  algorithm  for  region 
number  propagation  was  based  on  the  boundary  check  procedure 
of  the  QflAD  SPLIT  program.  Since  it  was  to  help  detect  the 
background  portions  of  the  image,  the  procedure  was  named 
Background  Region  Check  ,  or  3AKREG_CK  for  short.  The 
procedure  was  to  read  the  region  number  information  from 
QUAD  SPLIT  into  a  new  array  which  then  can  be  changed 
without  affecting  the  original  record. 

The  same  type  of  boundary  checking  as  discussed 
previously  was  utilized  to  detect  a  break.  If  a  break  was 
detected  on  the  opposite  side  of  the  boundary  within  +5  to 
-5  positions  of  the  original  break,  then  the  pair  of  two 
adjacent  regions  above  (or  to  the  left)  of  the  break  would 
be  assigned  the  regicn  number  of  the  region  to  the  left  for 
HS  boundaries  (or  the  region  on  top  for  EW  boundaries) ,  and 
the  pair  of  adjacent  regions  on  the  other  side  of  the  treak 
would  be  assigned  the  region  number  of  the  region  below  and 
to  the  left  of  the  break  for  NS  boundaries  (or  above  and  to 
the  right  of  the  break  for  EW  boundaries) .  A  pictorial 
diagram  of  the  above  situation  is  given  as  Fig.  4.1.  If  no 
break  is  found  in  the  adjacent  boundary,  then  no  changes  are 
made. 

Cne  potential  problem  that  was  realized  at  this 
point  was  the  situation  where  multiple  breaks  on  one  side  of 
the  boundary  were  matched  by  offset  multiple  breaks  on  the 
adjacent  boundary  within  the  +5  to  -5  position  range.  For 
example,  (see  Fig.  4.2),  assume  we  are  checking  column  64 
and  a  break  is  encountered  at  row  15,  with  the  region  above 
the  break  designated  region  'A*  and  the  region  below  the 
break  region  'C.  A  corresponding  break  on  the  opposite 
side  cf  the  boundary  (column  65)  occurs  at  row  19,   which  is 
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Figure    4.1        Example   of   Boundary   Checking, 

30 


within  the  +5  to  -5  position  range.  Call  the  region  above 
this  treak  region  * B*  and  the  region  below  as  region  *  D*. 
Since  corresponding  breaks  on  both  sides  of  the  boundary 
have  been  found,  then  region  propagation  occurs  with  regions 
fA'  and  'B1  being  assigned  region  number  'A',  and  regions 
■C  and  'D1  being  assigned  region  number  'C*.  Checking  now 
continues  down  column  64  for  another  break  and  assume  for 
this  example  that  it  occurs  at  row  23  with  region  '  C  above 
the  break  and  region  "E1  below.  Checking  adjacent  column  65 
would  shew  a  break  at  row  19  again  since  it  is  still  within 
+5  to  -5  positions  of  this  new  break  in  column  64,  while  an 
additional  break  in  column  65  at  row  24  would  be  missed. 

lo  alleviate  this  problem  additional  steps  were 
incorporated  so  that  once  two  adjacent  breaks  have  been  used 
for  region  number  propagation,  then  neither  can  be  used 
again  by  additional  breaks.  Also  it  was  noted  that  only  one 
pass  along  a  given  set  of  adjacent  boundaries  is  sufficient 
for  this  check  because  once  one  boundary  is  checked  and 
compared  to  its  adjacent  boundary,  then  all  of  the  possible 
connected  regions  will  have  been  recognized  and  no  further 
information  would  te  gained  by  checking  the  adjacent 
boundary  against  the  original  toundary. 

2.   fiegion  Map  Output 

The  assignment  of  new  region  numbers  from  1  to  64 
was  implemented  by  a  reiterative  routine  which  would  run 
from  1  to  4096  checking  the  region  number  array  at  each 
position.  When  an  original  region  number  was  found,  it  was 
reassigned  a  new  region  number  starting  with  1  and  going  up 
to  the  maximum  number  of  regions  utilized.  Each  time  a 
position  was  reassigned  a  new  region  number  a  counter  would 
be  incremented  and  this  count  was  compared  to  the  maximum 
number  of  postions  available  (65536)  and  would  stop  the 
iteration  once  this  was  reached. 
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Figure  4.2   Boundary  Checking  Example  for  Multiple  Breaks, 
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lo  simplify  processing  throughout  this  set  of 
procedures,  this  reassignment  of  region  numbers  was  incorpo- 
rated with  the  inputing  of  the  information  from  the  QOAD 
SPLIT  region  number  record. 

An  additional  nine  characters  was  also  added  to  the 
list  cf  characters  utilized  to  represent  the  region  numfcers. 
The  characters  were  then  assigned  to  respective  region 
numbers  after  the  region  number  propagation  procedure  was 
completed  to  give  a  hardcopy  output  available  in  four  128  X 
128  segments. 

3 .   Geometry 

The  procedures  for  area,  perimeter,  and  center  of 
gravity  (centroid)  were  the  only  SPIDER  procedures  utilized. 
Ihe  procedures  for  size  and  compactness  both  called  the  area 
and  perimeter  procedures  and  then  applied  a  simple  equation 
to  produce  their  respective  outputs.  Since  the  area  and 
perimeter  outputs  were  already  available,  the  following 
equations  were  used  to  directly  calculate  the  size  and 
compactness : 

size  =  (2  X  area)  /  perimeter 
compactness  =  (4  X  PI  X  area)  /  perimeter 

D.   CCUCIUDIHG  BEHARKS 

The  program  has  row  been  thoroughly  reviewed  and  new 
procedures  have  been  formulated  and  implemented.  The  proce- 
dures as  written  are  provided  as  Appendices  A  thru  E.  The 
whole  package  must  new  be  brought  together  so  that  test  runs 
with  real  data  can  be  observed.  The  testing  and  evaluation 
of  the  program  is  the  subject  of  the  next  chapter. 
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V.  TEST  AND  EYAXOATION 

The  basic  ideas  behind  all  of  the  programs  have  been 
looked  over  extensively  and  the  algorithm  changes  to  these 
programs  are  implemented.  The  testing  of  all  procedures 
with  the  infared  image  data  is  the  subject  of  this  chapter. 
The  evaluation  of  the  test  data  and  conclusions  reached  are 
in  the  final  sections. 

A.   EIPEBIHEITAI  HESDITS 

Testing  was  an  on  going  effort  during  the  entire 
research  period.  As  each  small  program  or  procedure  was 
written,  it  would  reguire  testing  to  verify  that  it  gave  the 
desired  results.  This  section  will  only  cover  the  testing 
of  the  major  programs  and  procedures  that  have  been 
discussed  in  detail  in  prior  chapters. 

1.   C.0AD  SPLIT 

The  QUAD  SPLIT  program  had  been  extensively  tested 
prior  to  this  work  and  the  limitations  that  were  encountered 
are  docuaented  in  Chapter  IV.  The  average  running  time  of 
the  program  for  the  infared  image  data  was  approximately  10 
minutes.  Fig.  5.1  is  an  example  of  a  portion  of  the 
segmented  output  listing.  This  example  makes  it  obvious 
that  the  output  is  very  disjointed  at  the  scope  view 
boundary  occuring  at  column  128.  It  would  be  very  difficult 
to  gather  any  useful  information  from  the  output  in  this 
form. 
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Figure  5-1        An   Example  of  QUAD   SPLIT   fiegion  Map  Output. 
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2 .   Background  Region  Check 

The  new  procedures  added  :o  the  QUAD  SPLIT  program 
are  the  real  essence  for  the  testing  conducted  in  this  work. 
As  a  new  procedure  was  added  to  the  original  program,  it  was 
tested  to  check  if  any  further  refinements  would  be 
required. 

a.   Region  Nunber  Propagation 

The  first  portion  of  the  background  region 
checking  procedure  to  be  implemented  was  the  region  propaga- 
tion algorithm  and  the  associated  new  region  map  output 
listing.  The  initial  tests  of  these  procedures  led  to  the 
detection  of  the  problem  where  the  same  region  symbol  was 
being  utilized  mere  than  once  in  the  same  region  map.  After 
the  incorporation  of  additional  steps  to  rectify  this 
problem,  a  series  of  tests  was  performed  using  five 
different  infared  images  as  the  input  data.  The  total  time 
for  each  program  to  run  was  approximately  16  minutes,  with 
the  fastest  completed  in  10  minutes  and  the  slowest  in  21 
minutes.  The  time  required  for  each  run  was  determined  by 
how  many  times  the  image  data  was  split  and  y  how  many 
regions  were  formed.  The  data  with  larger  tare  ;ts  had  less 
regions  and  therefore  ran  the  fastest.  The  same  portion  of 
segmented  output  listing  as  presented  in  Fig. 5.1  but  with 
region  nuirber  propagation  in  effect,  is  given  in  Fig. 5. 2. 
As  can  be  seen,  the  scope  view  boundary  at  column  128  has 
been  virtually  eliminated  and  background  features,  such  as 
regions  •B,  M,  and  J1,  which  propagate  across  the  entire 
output  section  are  easy  to  pick  out.  For  each  of  the  five 
different  infared  inages  used,  successful  region  number 
propagation  was  observed.  The  background  region  map  outputs 
are  presented  as  Fig. 5. 3,  Fig. 5. 4,  Fig. 5. 5,  Fig. 5. 6, 
Fig. 5.7,  Fig. 5. 8,  Fig. 5. 9,  Fig. 5. 10,  Fig. 5. 11,  and  Fig. 5.  12. 
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figure  5-2   Region  Bap  Output  with  Region  Number  Propagation 
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Figure    5.3        Image    A  Background   Region    Map — col-    1    to    128. 
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Figure    5,4        Image  1    Eackground   Region   Map — col.    129   to   256. 
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Figure  5.5   Iaage  E  Background  Begion  Map — col.  1  to  128. 
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Figure   5.6        Iaage  B   Background   Region   Map — col.     129   to   256. 
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Figure  5-7   Image  C  Background  Region  Map — col-  1  to  128. 
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Figure   5.8       Iaage  C   Background  Region   Map — col.    129  to  256. 
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Figure  5-9   Image  E  Background  Region  Map — col.  1  to  128. 
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figure  5.10   Image  D  Background  Region  Map — col.  129  to  256. 
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Figure  5.11   Inage  1   Background  Region  Map — col.  1  to  128. 
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Figure   5-12        Image    E  Background   fiegion  flap — col-    129   to  256, 
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t.   Geometry 

The  procedure  for  obtaining  the  area,  perimeter, 
centroid,  size,  and  compactness  for  each  of  the  regions  was 
tested  next.  Each  of  the  individual  FORTRAN  procedures  were 
tested  separately  by  short  routines  with  dummy  input  data  to 
ensure  that  the  desired  result  would  be  obtained  and  to 
verify  that  all  required  parameters  were  supplied  correctly. 
Each  of  these  were  tested  satisfactorily  and  then  the  area, 
perimeter,  and  centroid  procedures  were  incorporated  into 
the  basic  program.  Since  size  and  compactness  can  be 
derived  from  the  area  and  perimeter  procedures,  it  was 
decided  to  save  some  calculating  time  by  using  the  eguaticns 
to  generate  the  desiied  result.  A  sample  listing  of  the 
data  generated  for  tie  regions  shown  in  Fig. 5. 2  is  given  in 
Table  1.  All  five  infared  images  were  processed  with  these 
added  procedures  and  less  than  one  minute  of  processing  time 
was  added  to  the  overall  run  time  respectively. 

B.   E^AIOATIOH  OF  DATA 

All  of  the  tests  have  now  been  completed.  The  data  must 
now  be  evaluated  to  determine  if  the  desired  results  of 
picking  cut  the  target  from  the  background  and  noise  are 
achieved.  Time  limitations  precluded  the  generation  of 
procedures  to  incorporate  the  program  for  this  purpose.  The 
following  evaluation  was  conducted  by  visual  examination  of 
the  data  and  some  manual  calculations. 

1 .   Eack ground  Regions 

After  reviewing  the  background  region  map  outputs, 
it  could  be  readily  observed  that  the  background  sections 
were  clearly  recognizable.  They  were  regions  that  went 
generally  across  mary  boundaries  and  contained  a  major 
portion  of  the  area.    From  the  Geometry  data  files,   it  was 
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TABLE  1  _. 

Sampl< 

e  Gee 

metry 

Data 

REGION 

Iiiicr 

AREA 

PERI- 

5I2II 

CENTEOID 

SIZE 

COMPACT 

1 

26 

18 

8 

97 

2,89 

1.008 

8 

48 

20 

35 

148 

4.80 

0.513 

S 

70 

46 

33 

138 

3.04 

0.416 

E 

3275 

348 

12 

167 

7.72 

0.057 

I 

25 

42 

3 

152 

1.19 

0.  178 

G 

15 

24 

9 

164 

1.25 

0.327 

E 

1981 

752 

14 

95 

5-27 

6.044 

I 

9 

16 

46 

156 

1.12 

0.418 

J 

1198 

22 

31 

160 

109 

31.  100 

I 

34 

32 

43 

172 

2.  13 

0.417 

H 

1234 

334 

23 

94 

7.39 

0.  139 

C 

1230 

356 

37 

65 

6.91 

0.  122 

0 

3815 

16 

48 

164 

477 

187.30 

f) 

190 

1  14 

4 

182 

3.33 

0.  184 

X 

35 

U2 

31 

131 

1.67 

0.249 
......  

noted  that  the  regions  with  the  largest  areas  and  size 
correlated  with  the  tackground  regions  noted  visually  in  all 
five  cases.  Therefore,  all  of  these  regions  could  be  easily 
eliminated  in  a  search  for  the  good  target.  In  the  example 
of  sanple  data  given  in  Fig. 5. 2  and  Table  1  the  regions  with 
symbols  'B,  H,  J,  M,  0,  and  U»  would  then  be  eliminated. 
For  the  five  infared  images  evaluated,  this  type  of  tack- 
ground region  determination  would  eliminate  one  third  cf  the 
regions  and  approximately  ninty  percent  of  the  area. 
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2-   Size  vs  Compactness 

A  correlation  between  size  and  compactness  was  then 
attempted  for  the  remaining  regions.  From  all  the  data 
obtained,  no  useful  correlation  could  be  obtained.  Even 
after  looking  at  the  background  region  map  outputs  and 
selecting  likely  candidates  to  check  for  any  correlation, 
none  could  be  found  that  would  cover  the  target  and  get  rid 
of  the  other  regions.  Using  the  output  map  of  Fig. 5. 2  as  an 
illustration,  the  regions  with  symbols  »8,  9,  and  X*  seem  to 
be  the  most  likely  candidates  for  being  the  target  repre- 
senting the  ship.  Checking  the  size  and  compactness  data 
for  these  three  regicns  from  Table  1  yields  a  size  range  of 
1.67  to  4.80  and  compactness  range  of  0.249  to  0.513.  Two 
other  regions  fall  within  this  size  range,  three  more  within 
the  compactness  range,  and  one  region  falls  within  both 
ranges.  Similar  results  were  observed  for  the  other  four 
images.  Mere  information  is  therefore  required  to  make  a 
good  decision. 

3.   Dimensions  of  Regions 

The  dimensions  of  the  regions  were  not  incorporated 
in  any  cf  the  procedures  for  the  program  under  test.  After 
reviewing  all  the  background  region  maps,  it  was  noticed 
that  there  were  numerous  long  and  thin  regions.  These 
regions  were  noted  to  be  usually  close  to  boundary  areas  and 
are  generally  caused  by  some  noise  or  distortion  in  the 
infared  image.  If  these  regions  were  eliminated,  an  addi- 
tional twenty  five  percent  of  the  total  regions  could  be 
removed. 

The  dimensiors  for  the  regions  remaining  after  tack- 
ground  region  elimication  for  the  example  sample  were 
obtained  from  the  region  map  output  and  the  results  are 
tabulated  in  Table  2  .    By   reviewing  all  the  data  from  the 
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five  infared  images,  it  was  noted  that  if  any  dimension  was 
of  length  3  or  less,  or  if  the  column  lenth  divided  by  row 
length  did  not  fall  within  a  range  of  0.1666  to  6,  then 
these  regions  could  te  assumed  to  be  noise  and  eliminated. 
Therefore,  from  Table  2  data,  region  symbols  »G,  I,  and  L1 
could  be  eliminated. 


""" 

TABLE 

2 

Sample 

Region 

Dimensions 

REGICN 

I 

50W    NUMBER    -. 

COLUMN    NUMBER 
Mil      HEX      OISTH 

~i3A7      ET~ 

iTNGTH 

1 

3 

7 

5 

125 

128 

4 

8 

33 

37 

5 

140 

156 

17 

9 

31 

36 

5 

130 

148 

19 

I 

1 

5 

5 

146 

158 

13 

G 

9 

10 

2 

159 

170 

12 

I 

46 

47 

2 

154 

159 

6 

I 

42 

45 

4 

159 

183 

25 

fi 

1 

9 

9 

162 

204 

42 

1 

30 

34 

5 

125 

139 

15 

I 

Another  use  cf  the  dimensions  of  the  regions  could 
be  to  use  them  in  conjunction  with  the  centroid  data  to 
locate  regions  which  are  in  close  proximity  to  each  other. 
The  infared  data  of  a  ship  usually  breaks  the  ship  up  into 
different  regions  because  of  the  difference  in  intensity  cf 
the  infared  radiaticn  given  off  by  different  areas  of  the 
ship.    Ihese  regions  would  all  be  close   together  and  this 
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fact  could  aid  in  the  selection  of  the  good  targets.  A 
simple  test  was  devised  for  taking  the  regions  that  are 
remaining  and  checking  to  find  out  if  both  the  row  and 
column  values  of  their  respective  centroids  are  within  a 
given  fixed  value.  For  the  five  infared  images  tested,  a 
value  of  ten  seemed  tc  work  satisfactorily.  For  the  sample 
data  cf  Table  1  this  test  would  be  satisfied  for  region 
symbols  '8  and  91  and  *  9  and  X1.  Therefore,  a  good  choice 
for  the  good  regions  representing  the  ship  would  be  the 
regions  designated  by  symbols  »8,  9,  and  X*#  which  were  the 
same  regions  selected  for  being  possibly  good  targets  from 
the  background  regior  map  of  Fig. 5. 2. 

Ihis  test  was  applied  to  the  other  four  test  images 
with  reasonable  results  being  obtained.  A  potential  problem 
could  be  with  an  image  of  many  small  objects  or  ships,  such 
as  ships  in  a  convoy,  which  would  produce  regions  not  close 
together  resulting  in  the  failure  of  this  approach. 

C.   CCHCIUSIONS 

The  research  work  reported  in  this  thesis  had  as  its 
major  objective  the  extraction  of  usable  target  information 
from  infared  image  data  using  the  recursive  image  segmenta- 
tion with  hierarchical  scope  view  technigue.  The  five 
infared  images  used  in  the  testing  were  processed  suffi- 
ciently to  yield  usalle  information. 

The  new  procedures  of  this  chapter  incorporated  into  the 
main  program  proved  tc  be  inadequate  for  using  its  output  to 
make  a  decision  as  tc  which  region  is  the  target.  By  visual 
and  manual  processing  this  decision  was  shown  tc  be 
possible.  Further  research  will  be  reguired  to  resolve 
these  inadeguacies. 

There  are  still  many  problems  that  must  be  solved  before 
this  type   of  procedure  can  be  useful   in  the   field.    The 
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major  problem  is  the  processing  time.  An  image  that  is 
small  with  considerable  noise  present  could  result  in  many 
regions  being  formed-  This  could  cause  the  processing  time 
to  easily  surpass  twenty  minutes.  This  is  clearly  unsatis- 
factory in  any  real  time  situation.  A  computer  engineering 
research  effort  to  reduce  the  complexities  and  excessive 
nests  and  loops  could  be  of  great  benefit. 

The  region  number  assignment  problem  that  was  dealt  with 
in  the  new  procedures  of  Chapter  IV  was  not  completely 
remedied.  Regions  that  are  unconnected  but  with  the  same 
region  symbol  assignment  occured  in  all  of  the  tests.  The 
assigning  of  unique  region  numbers  must  be  approached  from 
within  the  main  program  if  this  problem  is  to  be  resolved. 
This  could  possibly  be  addressed  in  conjunction  with  some 
other  research  effort  utilizing  the  QUAD  SPLIT  program. 

An  initial  objective  of  the  research  was  found  to  be 
overly  ambitious  once  the  complexities  of  the  programs  began 
to  surface.  The  objective  of  producing  a  possible  hardware 
realization  of  the  procedure  was  therefore  not  pursued. 
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APPENDIX    A 
PROCEDURE    EAKREGMAP 

PROCEDURE    EAKREGMAP 

(*    Ihis  procedur€   takes   the   region   number 
cutput   of  QUAD    SPLIT   and   assigns   new 
region    numbers   from    1    to    64    in   a   new 
array.      Regicn   number   propagation   is 
performed,    the  new  region  map  is   output, 
and   geometry   calculations  are  made.  *) 

TYPE 

EACKBEGIONMAP    =    RECORD 

BRMAP_PIX    :    AREAY     {GROW_NC, GCOL_NO}     OF    GREG_NO 
END; 

VAR 

BEEGMAP  :  °BACKREGIONMAP; 
I,  J,  X,  Y,  Z  :  IKTEGER; 

END  A  :  BOOLEAN; 

FCUNE  :  ECOLEAN; 

BEGIN 

NEW     (EREGMAP) ; 
WITH    BREGMAP0    DO 

FOB    I    :=    1    TO    GEOW_MAX    DC    BEGIN 
FOR    J    :=    1    TC    GCOL_MAX    DO    BEGIN 

BRMAP_PIX  {I,J}     :=    GEEGMAP°.GRMAP_PIX {I , J}  ; 
END; 
END; 
Y    :=    0; 

ENEA    :=   FALSE; 
Z    :=    1  ; 
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FOF    X    :=    1    TO    U096    DO    BEGIN 
IF    ENDA    =    FALSE    THEN    BEGIN 
FOR    I    :=    1    TO    256    DC    BEGIN 
FOE    J    :=    1    TO    256   DO    BEGIN 

IF    BREGflAP°.BBMAP_PIX{I,J}     =    X    THEN    BEGIN 
IF    Z    >    63    THEN    Z    :=    64; 
BREGMAP°.BRHAP_PIX{I,J}     :=    Z; 
FOUND    :=    TRUE; 
Y   :=   Y  ♦    1; 

IF  Y  >=  65536  THEN  ENDA  :=  TRUE; 
END; 
END; 
END; 

IF  FOUND  =  IRUE  THEN  BEGIN 
Z  :=  Z  ♦  1; 
FOUND  :=  IALSE; 
END; 
END; 
ENE; 

BAFBHD_CK  (1) ; 
OC1BAKHAP; 
GECMETRY; 
END; 
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APPENDIX    B 
PEOCEDORE    EAKBND_CK 

FROCEEURE    EAKBND_CK     (QUADNO    :     QNODE_NO) ; 
(*   Background   boundary    check   *) 

(*      This   procedure   segments   the   image   into 
guadrants   and   then   calls   the  function 
BAKSPLT_CK   to  check   the   guadrant 
boundaries    fcr   breaks.  *) 

VAE 

EER_CLEAN,  NS_BDE,  FWARD_CK  :  BOOLEAN; 
BER_SIZE,  BDR_HAIE  ;  32.-256; 
EE  :  GROW_NO; 
BC  :  GCCL_NO; 
B1EVE1  :  LEVEL_NC; 

3EGIN 

E1EVEI    :=    QN     {QUAENO} °. QLE^EL; 

flEITELN     (LISTING,    'QUAD    NODE',     QUADNO) ; 

IF    CN     {QUADNO} °. STATUS    =    SPLIT    THEN    BEGIN 

IF    CN     {QN     {QUAENO}  °.NW_SCN}°.  STATUS    =    SPLIT    THEN 

EAKBND_CK     (QN     {QUADNO}  °.  NW_SON)  ; 
IF    CN     {QN     {QUAENO} °.NE_SON}°. STATUS    =    SPLIT    THEN 

EAKBND_CK     (QK    {QUADNO}  °.  NE_SON)  ; 
IF    CN     {QN     {QUAENO}  °.SW_SCN}°. STATUS    =    SPLIT    THEN 

EAKBND_CK     (QN    {QUADNO} °. SW_SON) ; 
IF    CN     {QN     {QUAENO}0. SE_SCN}°. STATUS    =    SPLIT    THEN 

EAKBND_CK     (QN    {QUADNO}  °.  SE_SON)  ; 
END; 
NS_EER    :=    TRUE; 
F«ARE_CK    :=    TR DE ; 
BR    :=    CN     {QUADNO}0. GROW; 


56 


BC    :=    £N    {QUADNO}0. GCOL; 
BDR_SIZE    :=    2    **    ELEVEL; 
BDR_HALF    :=    BDB_SIZE    DIV    2; 
EER_CLEAN    :=    FALSE; 
flBILE    BDR_CLEAN    =    FALSE    DO    BEGIN 
EDE_CLEAN    :=    TEDE; 

WRITELN     (LISTING,     »NS    FORWARD    CHECK1); 
IF    BAKSPLT_CK     (NS_BDR,    FflABD_CK)     THEN 

EDR_CLEAN    :=    PALSE; 
ENE; 

WEITELN     (LISTING,     • NS    EEVEESE    CHECK'); 
IF    BAKSPLT_CK     (NS_BDR,    NOT    FWARD_CK)     THEN 

EDR_CLEAN    :=    FALSE;    ' 
END; 

WEITELN     (LISTING, 'EW    FORWARD   CHECK')  ; 
IF    BAKSPLT_CK     (KOT    NS_BDE,    FWARD_CK)     THEN 

EDE_CLEAN    :=    FALSE; 
ENE; 

WRITELN     (LISTING, • EH    REVERSE    CHECK'); 
IF    BAKSPLT_CK  (NCT    NS_BDR,NOT    FWARD_CK)     THEN 

EDB_CLEAN    :=    FALSE; 
ENE; 
IF    BDR_CLEAN    =    FALSE    THEN    BEGIN 

IF    QN     {QN     {QUADNO}0. NW_SON} °. STATUS    =    SPLIT    IHEN 

BAKBND_CK     (CN     {QUADNC}  °.  NW_SON)  ; 
IF    QN     {QN     {QUADNO} °. NE_SON} °. STATUS    =    SPLIT    THEN 

BAKBND_CK     (QN     {QUADNC} °- NE_SON) ; 
IF    QN     {QN     {QUADNO}  °.SW_SON} °. STATUS    =    SPLIT    THEN 

BAKBND_CK     (CN     {QUADNC} °.SW_SON) ; 
IF    CN     {QN     {QUADNO}0. SE_SON}°. STATUS    =    SPLIT    IHEN 

BAKBND_CK     (CN     {QUADNC} °. SE_SON) ; 
END; 
ENE; 
END; 
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APPENDIX  G 
FUNCTION  BAKSPLT_CK 

FUNCTION  BAKSP1T_CK  (KS  :  BOOLEAN; 

EORWARD  :  BOOLEAN)  :  BOOLEAN; 

(*   This  function  checks  each  boundary  within 
a  quadrant  for  breaks  on  both  sides  of  the 
boundary.   If  this  occurs,  the  adjacent 
regions  across  the  boundary  are  assigned 
the  same  region  number.   This  is  referred 
to  as  region  number  propagation.  *) 

TYPE 

BBK_TYFE  =  1..257; 

VAE 

FEEV_TEE,  PREV_REG,  NOW_REG,  NNOW_REG  :  REG_NO; 

SC,  NSC  :  GCOL_NO; 

BC_LIMIT,  BRK,  BF_LIMIT  :  ERK_TYPE; 

SB,  NSR  :  GROW_NC; 

NERK,  PREV_NBRK  :  -3. .255; 

A1EE  :  EOOLEAN; 

I,  J,  K  :  INTEGER; 

BEGIN 

EAKSPLT_CK  :=  FAISE; 
FEEV_NEEK  :=  0; 
PBEV_TEE  :=  0; 
WITH  EREGMAP0  EO  EEGIN 
IF  NS  THEN  BEGIN 

IF  FORWARD  TEEN  BEGIN 

SC  :=  BC  +  EDR_HALF  -  1  ; 
NSC  :=  BC+  EDR_HALF; 
END; 
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ELSE    BEGIN 

SC    :=    BC    ♦    EDR_HALF; 
NSC    :=    BC+    EDR_HALF    -    1  ;"" 
END; 

SB    :=    BR; 
END; 
ELSE    BEGIN 

IF    FORWARD    TEEN    BEGIN 

SR    :=    BR    *    EDR_HALF    -    1; 
NSR    :=    BR    ♦    EDR_HALF; 
END; 
ELSE    BEGIN 

SR    :=    BR    ♦    EDR_HALF; 
NSR    :=    BR    +    EBR_HALF    -    1; 
END; 

SC    :=    BC; 
ENE; 
PEEV_REG    :=    BRMAP_PIX     £SR,SC}; 
NCW_EEG    :=    PREV_REG; 

IF    NS    THEN    BRK    :=   BR    ELSE    BRK    :=    BC; 
BE_IIMIT    :=    BR    ♦    £DR_SIZE; 
BC_LIMIT    l-    BC    ♦    EDR_SIZE; 

WHILE     (  (NS    AND     (EEK    <    BR_LIMIT) )     OR     ((NOT    NS) 
AND     (BRK    <    BC_LIMIT))) 
EO    BEGIN 

WHILE     (({NS    AN!     (BRK    <    BR_LIMIT) )     OR     ((NOT    NS)     AND 
(BRK    <    BC_LIHIT)))     AND     (NOW_REG    =    PEEV_REG) ) 
EO    BEGIN 

PEE7_REG    : +    NCW_REG; 
ERK    :=    BRK    ♦    1; 

IF     (BRK    <    25*7    )     THEN    IF    NS    THEN 
NOW_REG     :=    ERMAP_PIX     [BfiK,SC} 
ELSE    NOW_REG    :=    BBMAP_PIX     {SR,  BRK}  ; 
END; 
IF     (((BRK    -    1)     MOD    128)     <>    0) 

59 


AND     (({BEK   -    1)     MOD    64)     <>    0) 
AND     (((BRK  -    1)     MOD    32    <>    0)) 

THEN    BEGIN 
ATEE    :=    TR0E; 
NBRK    :=    BEK   -4; 

IF    NS    AND     (NBRK    <    BE    THEN    NBRK    :=    BE; 
IF    (NOT    NS)    AND     (NBRK    <    BC)     THEN    NBRK     :=    BC; 
FOR    I     :=    1    TO    8    DO    BEGIN 
IF    NS    THEti    BEGIN 

NPREV_REG    :=    BRMAP_PIX     (NBRK, NSC}; 
NNOW_REG    :=    BRMAP_PIX     {NBBK    ♦    1,    NSC}; 
END; 
ELSE    BEGIN 

NPEEV_EEG    :=    BEMAP_PIX     {NSE,NBRK}; 
NNOH_BEG    :=    BEMAP_PIX     {NSE,NBBK    ♦     1}; 
END; 

IF     (NPEEV_BEG    <>    NNOW_REG)     THEN    BEGIN 
ATEE    :=   FALSE; 
IF    FOEWAED    THEN    BEGIN 

IF     (PEEV_NBEK    <    NBRK)     THEN    BEGIN 
IF    NS    THEN    BEGIN 

ECE    K    :=BE    TO     (BE_LIMIT   -    1)     DO    BEGIN 
FOR    J:=    NSC    TO    BC_LIMIT-1)     DO    BEGIN 
IF    BRMAP_PIX     {K,J}     =    NPREV_REG 
THEN    BEGIN 

BRMAP_PIX     {K,J}     :=    PREV_REG; 
END; 

IF    BRMAP_PIX{K, J}=    NNOW_REG 
THEN    BEGIN 

BEMAE_PIX     {K,J}     :=    NOW_REG; 
END; 
END; 
END; 
END; 
ELSE    BEGIN 

60 


FCR    K    :=    NSR    TO     (BR_LIMIT-1)     DO    BEGIN 
FOR    J    :=    SC    TO     (BC_LIMIT-1 ) DC    EEGIN 
IF    BRMAP_PIX     [K,J}     =    ?REV_REG 
THEN    BEGIN 

BRMAF_PIX     {K,J}     :=    PREV_REG; 
END; 

IF    BRMAP_PIX     {K,J}     =    NNOfl_REG 
THEN    BEGIN 

BRMAP_PIX     {K,J}     :=    NOW_REG; 
END; 
END; 
END; 
ENE; 

PRE?_NBRK    :=    NBRK; 
END; 
END; 
END; 
ELSE    BEGIN 

NBRK    :=    NBRK    «•    1  ; 

IF  NS  AND  (NBRK  <  3R)  THEN  NBRK  :=  BC; 

IF  (NOT  NS)  AND  (NBRK  <  BC)  THEN  NBRK:=BC; 

IF  NS  AKD  (NBRK  >  BR_LIMIT  -  2)  THEN 

NBRK  ;=  BR_LIMIT  -  2; 
END; 
IF  (NOI  NS)  AND  (NBRK  >  BC_LIMIT  -  2)  IHEN 

NBRK  :=  BC_LIMIT  -  2; 
END; 
END; 
END; 
IF  ATEE  THEN  BEGIN 

HRITELN  (IISTING,' BREAK  AT  =',BRK, 

'NEIGHBOR  AT',  NBRK) ; 
PREV_TEE  :=  BRK; 
END; 
END; 
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EJEV_REG    :=     NCW_REG; 
ENE; 
EKD; 
END; 
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APPENDIX  D 
PROCEDURE  GOTBAKMAP 

PROCEDURE  OUTBAKMAP  (*  Background  Region  Map  Output  *) 

(*   This  procedure  assigns  symbols  to  the 
region  numbers  for  printer  output.   The 
output  is  formatted  into  four  pieces  of 
128  X  128  tc  produce  the  entire  output.   *) 

VAR 

RCH  ;  ARRAY  {1.-64}  OF  CHAR; 

CBS  :  PACKED  ARRAI  {1..64}  OF  CHAR; 

Rr  C  :  INTEGER 

PRCCEDDRE  BLANKLINE  (N  :  INTEGER) ; 

VAR 

I  :  INTEGER; 

EIGIN 

FOE  I  :=  1  TC  N  DO  WRITEIN  (LISTING) ; 
END; 

PROCEDURE  MAKEDOT; 

EEGIN 

WRITE     (LISTING,'         *')  ; 
FOR    C    :=    1    TO     128    DO    BEGIN 

IF     (C    MOD    10)    =    0    THEN    WRITE     (LISTING, * ♦  ') ; 
ELSE   WRITE     (IISTING,*     •)  ; 
END; 

WRITE     (LISTING, »*»)  ; 
WRITELN    (LISTIKG) ; 
END; 

BEGIN     (*    CUTBAKMAP    *) 
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CES  :=  »0123456789ABCDEFGHIJKLMNOPQRSTOVWXYZ" ()<> 
(*  keyboard  dees  not  have  all  the  characters 
that  VAX- "750  has  *)  ; 
FCR  E  :=  1  TO  64  EO  RCH  {R}  :=  CHS{£}; 
BIAIKIIHE  (10)  ; 

WRITELN  (LISTING,*  REVISED  GLOBAL  REGION  MAP'); 
ElAfKLINE(3)  ; 
MfiKEEOT; 

WRITE  (LISTING, •     ») ; 

FCR  C  :=  1  TO  64  £0  WRITE  (LISTING, RCH £C} ) ; 
WBITEIN  (LISTING); 
MAKEECT; 

WITH  BBEGMAP0  DO  EEGIN 
EIAIK1INE  (3) ; 
MAKEECT; 
ECR  R  :=  1  TO  128  DO  BEGIN; 

WRITE  (LISTING, F:  3,"  ")  ; 

EOE    C    :=     1    TO    128    DO    BEGIN 

WRITE     (LISTING, RCH {BRMAP_PIX £R,C}     MOD   64} ) ; 

END; 

WRITELN     (LISTING) ; 
EKD; 

EIAKKLINE  (3); 
MAKEECT; 
FOR  R  :=  1  TO  128  DO  BEGIN 

WRITE  (LISTING, B:3,»  *); 

FOE  C  :=  129  TC  256  DO  BEGIN 

WRITE  (LISTING, RCH £BRMAP_PIX  {R, C}  MOD  64} )  ; 

ENE; 

WRITELN  (LISTING)  ; 
END; 

EIAi>FLINE     (3)  ; 
MAKEEOT; 
FCE    E    :=    129    TO    256    DO    BEGIN 

WRITE     (LISTING, E:3,»     '); 
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FOE    C    :=    1    TO     128    DO    BEGIN 

WHITE     (LISTING, RCH £ERMAP_PIX  {B,C}     MOD    64} )  ; 

END; 

WRITELN     (LISTING) ; 
END; 

EIAIKIINE  (3) ; 
MAKEEOT; 
FOE  E  :=  129  To  256  DO  BEGIN 

WRITE  (LISTING#R:3,»  •); 

FOE  C  :=  129  TC  256  DO  BEGIN 

WRITE  (LISTING,  RCH {BEHAP_PIX £R, C}  MOD  64}); 

ENE; 

WRITELN  (LISTING); 
END; 

MAKEDCT; 
ENE; 
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APPENDIX  E 
EROCEDURE  GEOMETRY 

PROCEDURE  GEOMETRY 

(*   This  procedure  calculates  the  area, 

perimeter,  ceiitroid,  size  and  compactness 
for  each  of  the  regioD  symbols  used. 
Output  format  is  for  printer  output.      *) 

TYPE 

XYZ  =  ARRAY  {1. . 256, 1. . 256)  OF  INTEGER; 

ZYX  =  ARRAY  {1..64}  OF  INTEGER; 

YZX  =  ARRAY  £1.. 64.1. .2}  OF  INIEGER; 

VAR 

IE  :  XYZ; 

AREAP  :  ZYX; 

CENTER  :  YZX; 

PEBIM  :  ZYX; 

SIZE  :  ARRAY  {1..64}  OF  REAL; 

COMPACT  :   ARRAY  }1..64}  OF  REAL; 

RCH  :  ARRAY  {1..64}  OF  CHAR; 

CHS  :  PACKED  ARRAY  {1..64}  OF  CHAR; 

J,  K,  L,  R,  C  :  INTEGER; 

EI  :  REAL; 

CONST 

MR  =  256; 
MC  =  256; 
NE  =  64; 
NC  =  4; 

PROCEDURE  AREA1 (IP : XYZ ; ISX : INTEGER ; ISY : INTEGER ; 

IRN: INTEGER; JF: ZYX; NR: INTEGER) ; FORTRAN; 
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PROCEDURE    CGHV1  (IP :XYZ ; ISX : INTEGER ; ISY : INTEGER ; 

IRN:INTEGER; JF: YZX;NR: INTEGER) ; FORTRAN; 
PROCEDURE    PRMT1  (IP  :XYZ; ISX :INTEGER ; ISY: INTEGER ; 

IRN:INTEGER; JF:ZYX;NR: INTEGER; 

NC:INTEGER) ;    FORTRAN; 

BEGIN 

FOR    R    :=    1    TO    256    DO    BEGIN 
FOB    C    :=    1    TO    256    DO    BRGIN 

IP{R,C}     :=    BREGMAP°.BRMAP_PIX{R,C}  ; 
END: 
END: 

FI    :=    3.1415926; 
CHS    :=    '012345678SABCDEFGHIJKLMNOPQRSTUVWXYZ" () <> 

(*   other   symbols   missing   on   this   keyboard   *) ; 
FOR    J    :=    1    TO    64    DO    RCH  {J}     :=   CHS  [J}; 
FCR    K    :=    1    TO    NR    10    BEGIN 

AREA1  (IP,MR,  MC,K,AREAP,NB)  ; 
IF    AREAP  {K}    >    0    THEN    BEGIN 

CGRV1 (IP,ME,MC,K,CENTEB,NR)  ; 

FRMT1  (IP,MR,MC,K,PERIM,NR,NC)  ; 

SIZE{K}     :=    2    *    AREAP  {K}    /    PERIM  {K}  ; 

COMPACT £K}     :=    4    *    PI    AEEAP  (K)    /    PERIM  [K}     **    2; 

WRITELN  (LISTING)  ; 

WRITELN  (LISTING)  ; 

WRITELN  (LISTING) ; 

WBITE  (LISTING, 'REGION  ',K:4); 

WRITE  (LISTING,',  SYMBOL  »,RCH}K  MOD  64}  :  1)  ; 

WRITELN  (LISTING) ; 

WRITE     (LISTING, 'AREA    ', AREAP  {K}  :5)  ; 

WRITE     (LISTING,*       CENTBOID    AT    ',  CENTER  (K  ,  1}  :  3, 

CENTER{K,2}  :  5)  ; 
WRITELN     (LISTING) ; 

WEITE     (LISTING, 'PERIMETER    ■ , PERIM  {K}  : 5)  ; 
WRITE     (LISTING,',       SIZE    ',SIZE{K)); 
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WRITE     (LISTING,*,       COMPACTNESS    », COMPACT  {K} )  ; 
WEITELN     (LISTING)  ; 
END; 

END; 
END; 
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